Synchronization in the presence of memory 
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Abstract 

We study the effect of memory on synchronization of identical chaotic systems driven by common 
external noises. Our examples show that while in general synchronization transition becomes 
more difficult to meet when memory range increases, for intermediate ranges the synchronization 
tendency of systems can be enhanced. Generally the synchronization transition is found to depend 
on the memory range and the ratio of noise strength to memory amplitude, which indicates on a 
possibility of optimizing synchronization by memory. We also point out on a close link between 
dynamics with memory and noise, and recently discovered synchronizing properties of networks 
with delayed interactions. 
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Since a generic study of Fahy and Hamman [1] synchronization of dynamical systems has 
become an active field of research. Examples of synchronous behavior are found in physical, 
biological, chemical and social systems Q], from a road traffic anticipation [jjj], population 
growth 4] and secure communications pi through biophysics jfj], chemistry [3] and laser 
optics J to computer science [9( . At least four types of synchronization scenarios have been 
identified [h]] of which the synchronization between identical systems coupled by a common 
noise has received much attention due to its relative simplicity and importance 11]. 

In recent years studies of synchronization were extended further to obey an important case 
of interactions that are delayed in time I2I, Q] • One of the most striking observations 
here was enhancement of synchrony for networks of many nonlinear interacting units by 

n n n □ 

time-delayed transmission of the signals [14 , Il5l . Il6l . Il7j |. More specifically, in a neural 



network model [15] an enhanced synchronization of neurons by delays has been observed. 
Similar effect was found for a network of coupled logistic maps 16|. Even a network of 
logistic maps with random delay times was able to sustain synchronization 17]. 

A purpose of this work is to show that the constructive influence of delays on synchro- 
nization can be extended further to obey a broad class of nonlinear systems with noise and 
memory, where the latter is understood as the auto-feedback with delay having distribution 
in time. A close link between the synchronizing networks under delay and synchronization 
by a common noise of (effectively decoupled) nonlinear systems with memory is also demon- 
strated. Detailed numerical calculations are carried out for generalized logistic maps and 
chaotic Fahy-Hamman systems described by non-Markovian Langevin equations. In both 
cases the choice of the models has been motivated by their well documented synchronizing 
properties in the limit of vanishing memory. Importantly, our analysis demonstrates that 
the presence of memory and noise not only can sustain synchronization existing in equiva- 
lent, memoryless systems, but also can enhance it. The models chosen, though governed by 
different dynamics, collectively display this possibility, which suggests that the effect can be 
quite common for nonlinear interacting systems. 



Memory 



systems 



and randomness naturally link with time evolution of interacting dynamical 



18, [l9 



|20| . Indeed, the evolution of a system coupled with 'external' degrees of 
freedom (e.g. open systems, nonlinear networks) can, at least in principle, be reduced to a 
dynamics of an effective single system, but with memory and noise. The effective system 
is usually more amenable to numerical, analytical and formal considerations. Perhaps the 
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simplest and exact example of such reduction is that of a nonlinear system coupled bi- 
linearly to harmonic oscillators. The elimination of the oscillator degrees of freedom results 
in a generalized Langevin equation for the dynamics of the system, where memory and noise 
terms are fully specified by the properties of the oscillators and by their coupling with the 
system [3| . Similarly, the dynamics of a network with delay times can be approximated by, 
or in some cases reduced to an effective dynamics of single nodes with memory and noise. 



Consider, for example, a network of coupled logistic maps with discrete time 
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13| . The 



state Xi(t + 1) of the node "z" at time t + 1 depends on the state Xi(t) of that node at time t 
and on the states Xj(t — Tij) of the nodes {" j ^ z"} that couple to "i" at earlier times {t-Ty}, 
where {r^} are the delay times (see e.g Eq. (1) in ). By iterating the equations for 

Xj(t — Tij) (j ytz back in time and re-substituting them to Xi(t+1) we arrive at the effective, 
single-node equations for Xi(t+1) expressed in terms of Xi(t) and the nonlinear auto-feedback 
(memory) T. For the network of logistic maps T is a polynomial in Xi(t — n), 1 < n < t 
with coefficients depending on network's connectivity and the initial values Xj(0) for the 
nodes. Any randomness in the original network like random delay times, random elements 
in network's connectivity, or averaging over Xj(0) goes into additive/multiplicative noise 
terms in the effective equations of motion. 

One of the simplest, but important, class of Ts is a linear auto- feedback with T ~ 
Ylk=i^k x i{t ~ which for example, can represent a 'mean-dynamics' of the above men- 
tioned networks of logistic maps. For V given by a polynomial in Xi(t — n) a recipe 
for getting {T^} of the 'mean-dynamics' would be e.g. a replacement of X{(t — n) by 
Xi(t — n) =< x > +[xi(t — n)— < x >] =< x > +5xi(t — n) and neglect of terms that 
are nonlinear in 5xf, (■) denotes the average over the trajectory and over initial conditions. 

The discussion as given clearly shows that memory and noise are intrinsic to dynamical 
evolution of a system. It is then important to know in what way they affect synchronization. 
We report on the noise-induced synchronization, which is generic for this case. The syn- 
chronizing system is characterized by master trajectories that divide the whole phase space 
onto basins of attraction such that all trajectories initiated in the same basin and subjected 
to the same sequence of the noise evolve to the same master trajectory [l, 9]. 

As our first model we consider an ensemble of chaotic logistic maps coupled by common, 
additive noises. Since the coupling is realized only through the noise terms it is sufficient to 
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explore just two such systems, which we define as: 

N 



X 



; +1 = 44(i-4) + i£r fc <_ fe + £n + 4 modi, (i) 

fc=i 

where % = 1, 2 and £ n is the non-symmetric, (^-correlated noise taken uniformly from the 
interval [a, a + b] . To avoid roundoff- induced synchronization we also add an extremely 
small independent uniform noise e l n (from interval [— 1CT 12 , 1CT 12 ]) to each particle at every 



211 ] . We extend our analysis to a symmetric version of ([T]) by defining a new 



iterated step 
variable 

Z n = X n~ ( X ) > (2) 

where (x) = (x l n ). For 1 = the noise-induced synchronization in the [a, 6]-plane has 



recently been studied in detail by Rim et al. [22J. We restrict ourselves to linear auto- 
feedback with T = IYlk=i rA,x n _fc. The set of coefficients {/r^} is the 'memory profile' and 
N is proportional to the memory range. Two models for the memory profile are considered 
in detail: the constant memory profile with 

f 1 for n < N, 

r n ^K={ " (3) 

I for n > N, 
and the exponentially decaying memory profile 

{exp(— An) for n < N, 
(4 ) 
for n > N. 

For iV ^> 1/A the inversion of A is the memory range. 

The stability of the synchronized states is determined by the sign of the (maximal) 
transversal Lyapunov exponent A for the dynamics of difference 5x n = x\ — x 2 n = z\ — z\. 
In the numerical calculations we choose at random the initial states {x^, x 1 N _ l , Xq} from 
the allowed interval and nearby states {x 2 N , x 2 N _ x , ...,Xq}. Then we iterate the equations of 
motion to construct statistics of the expansion and contraction rates: A» = In ( nff^r ) °f 
Sx n . The procedure, repeated for many rando mly chosen initial states, allows us to calculate 



the average of Aj, which approximates A 13j, [l5|, [22j. 



In case of non-zero memory we generally find that for large enough absolute noise inten- 
sity, |/|, the synchronization is destroyed for all N > 1. Results are shown in Fig. [1] where 
|/|, above which the synchronization region disappears, is sketched. For |/| exceeding the 



4 



threshold value the systems de-synchronize for all a and b. Choosing A = -j| we find that the 
results compare well for both memory profiles. In this case T e N at n = N is about an order 
of magnitude smaller than at n = (T e N = e~ 2 ). The effect is illustrated further in Fig. [2, 



Figure 1: Threshold lines for symmetric map ([2]): (a) T^, I < 0, (b) T^, / > 0, (c) T^, I < 0, and 
(d) T^, / > 0. For r^j cases we take A = j^. 

where the evolution of the synchronizing boundaries, A(a, b) = 0, are shown with increasing 
(positive) intensit y fo r the symmetric map (T5]) and for different memory profiles. The case 



without memory [22| is also shown for comparison. Please note that the synchronization 
area shrinks with increasing intensity and range of the memory. This behavior is observed 
for N > 1, for positive and negative intensities, and for all maps studied. Interestingly, the 



Figure 2: Synchronization areas for symmetric map. Region (a) corresponds to system without 
memory Q- Left plot is done for T c n with (b) N = 5, / = 0.1 and (c) N = 5, I = 0.3. Right plot 
corresponds to with A = A and with (d) N = 5, I = 0.1 and (e) N = 5, / = 0.5. 

maxima in Fig. [TJ prove that memory can also act on synchronization in a constructive way 
by enhancing it. We observe the enhancement of synchrony by memory for both memory 
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profiles, which indicates that the phenomenon can be quite general. Indeed, as demon- 
strated below systems with a more complex dynamics, governed by the integrodifferential, 
generalized Langevin equation, show similar behavior. We discuss the possible implications 
of these results toward the end. 

Memory profile is closely linked to a time-time autocorrelation function 

Ck = ((-Cn - (x)) (x n -k - (x))) ^ 
(0„ - (x)) 2 ) 

We monitored the behavior of this function inside- and outside of the synchronizing area. 
Exemplary results are shown in Figs. [3] and HI The decay time r in Fig. H] was calculated 
by assuming that Ck is a linear combination of trigonometric functions multiplied by an 
exponential decay of the form \Ck\ = exp (— We observe in Figs. [2] and HJ that close 
to the border of the synchronizing area r is enhanced by the presence of memory, with the 
maximum positioned outside this area. That is, the chaotic systems with larger r 'remember 
for longer' about their initial conditions, which makes synchronization more difficult and 
explains intuitively the shrinkage of the areas in Fig. [2j 



Figure 3: Correlation functions for the symmetric map with constant memory (C c k ) and without 
memory (C° fc ). Here N = 5, I = 0.1, b = 0.1, a = 5.3 ( a = 5.55 for insets). 

The second model with which we explore influence of memory on noise-induced synchro- 
nization is the generalization of the Fahy-Hamman system 1|. We analyze trajectories of 
two identical particles in a two dimensional potential well given by: 

sin27rxi sin27ra 2 (x 2 + xV) 2 , , 

V( Xl ,x 2 ) = — + — + 1 2 2> , 6 

ZTTX-i 27TXo lb7T z 
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Figure 4: Decay time of C/% as a function of noise parameter a. Cases studied are: (a) constant 
memory and (b) exponential memory for / = 0.1 and A = 2/N. The case (c) corresponds to 1=0. 
The remaining parameters are N = 5 and b = 0.1. 

with different initial conditions. The motion of the z-th particle (z = 1, 2) is governed by the 
generalized Langevin equation: 

ma* (f) = - dV{ ^ l) - ml f T(t - t') ±J,(f) dt> + £(t), (7) 

where m is the mass, I is again the memory intensity or, in this case, the friction constant. 
The noise £, common for both particles, is a T-correlated stochastic force with zero mean, 
where correlations are obeying fluctuation-dissipation theorem: 

((am(t')))=2mIk B TT(t-t'), (8) 

with T being the absolute temperature and kg the Boltzmann constant. In what follows we 
restrict ourselves to the exponentially correlated noise by choosing, as in Eq. (j3J), T{t — t') = 
e -A(t-t')_ Double angular brackets denote averaging over a noise realization. The equations 
of motion (j2j) are integrated numerically using stochastic version of the Euler algorithm. 
Discretization of the equations © entails re-scaling the noise strength by a factor 1/y/At, 
where At is the time step. Finally, the exponentially correlated noise is generated from 
uniformly distributed random numbers through Ornstein-Uhlenbeck process. As previously, 
simulations are carried out to determine the maximal Lyapunov exponent, A, as function 
of memory range (1/A) and I. We used a natural system of units: energy e u = V(0,0) — 
V m in ~ 2.41, time t u = v3 measuring curvature of the potential at origin and length l u = 1 
giving the period of the oscillating part of the potential. In the absence of memory the 
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system was originally studied by Fairy and Hamman [lj using regular Andersen thermostat. 
The results unambiguously showed that trajectories were exponentially convergent to a 
common trajectory after a transient period. The same phenomenon has been reported for a 
Langevin dynamics without memory of a one-dimensional Lennard- Jones chain [23| and of 
other systems 

Calculations of A in the presence of memory as function of 1/A are shown in Fig. [51 
Please note that the dependence of A on 1/A is much more complex now than that previ- 
ously observed for the maps. At least three regimes can be identified. In the first regime, 
corresponding to a short memory range, we observe de-synchronization of the system by 
memory. However, after reaching maximum, A drops down and for intermediate memory 
range synchronization is considerably enhanced. The strongest synchronization conditions 
are met for 1/A ~ 0.14, where A approaches minimum. Interestingly, the positions of the 
extremes are practically independent on I. 



Figure 5: Maximal Lyapunov exponent A against memory strength 1/A for three different friction 
constants I and the reduced temperature ksT = 1. 

Summarizing, the results obtained for the generalized logistic maps and for the dynamical 
system evolving according to the generalized Langevin equation uncover a possibility of hav- 
ing the constructive influence of memory on the noise-induced synchronization. The results 
are quite counterintuitive for, in the first place, we would expect that memory by introduc- 
i„ g extra d,,_ Q should act in juS t the opposite way, „ making synchronization 
more difficult [la, H3j. Though the proposed models are relatively simple they represent 
quite different dynamics, which suggests that the uncovered enhancement of synchrony by 
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memory can be a general phenomenon, occurring for a wide class of nonlinear dynamical 
systems with memory and noise. They rise a possibility of seeking for a right memory profile 
to create optimal conditions for synchronization to occur i.e. optimizing synchronization by 
memory. Additionally, our findings apart from giving yet another example of the nontrivial 
interplay between memory and noise, show a close relation to the synchronizing properties 
of coupled networks with delays that have recently been discovered. 
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